Mobile terminal, display apparatus and control method thereof

ABSTRACT

Disclosed is a control method for a display apparatus and a mobile terminal which includes a camera for taking a photograph and generating an image; a voice input unit which is used to input a voice; a user input unit which receives a user&#39;s input; a display unit which displays the image thereon; a wireless communication unit which communicates with a counterpart mobile terminal through a wireless network; and a controller which performs a video call by transmitting to the counterpart mobile terminal video call data comprising a video generated by the camera and a voice input by the voice input unit according user input, displays on the display unit a shared image during the video call, and transmits to the counterpart mobile terminal the shared image added to the video call data.

PRIORITY

This application is a continuation application of prior application Ser.No. 15/440,570, filed on Feb. 23, 2017, which is a continuationapplication of prior application Ser. No. 15/359,270, filed on Nov. 22,2016; which has issued as U.S. Pat. No. 9,740,451 on Aug. 22, 2017,which is a continuation of prior application Ser. No. 13/858,618, filedon Apr. 8, 2013, which issued as U.S. Pat. No. 9,554,088 on Jan. 24,2017; which is a continuation of prior application Ser. No. 12/943,401,filed on Nov. 10, 2010, which issued as U.S. Pat. No. 8,436,887 on May7, 2013; and claims the benefit under 35 U.S.C. § 119(a) of a Koreanpatent application filed on Nov. 13, 2009 in the Korean IntellectualProperty Office and assigned Application Serial No. 10-2009-0109774, theentire disclosure of each of which is hereby incorporated by reference.

BACKGROUND OF THE INVENTION 1. Field of the Invention

The present invention relates generally to a mobile terminal, a displayapparatus and a control method thereof, and more particularly, to amethod and apparatus in which a mobile terminal shares images and imageinformation with a counterpart mobile terminal during a video call.

2. Description of the Related Art

In recent years, mobile terminals such as mobile phones, PortableDigital Assistants (PDAs) and mobile Personal Computers (PCs) are beingwidely used and drawing much attention due to improved functionality andperformance. Such mobile terminals provide not only callingfunctionality but also a multimedia functionality such as playing musicor movies, message transmitting and receiving functions including textmessages and voice messages among other various functions.

Particularly, mobile terminals are capable of providing video callfunctionality by which a user may send or receive video as well as voicewhile talking over the phone with a counterpart. During such video call,sufficient and free information sharing is needed.

SUMMARY OF THE INVENTION

Accordingly, the present invention provides a mobile terminal includinga camera which captures image and generates photograph and video; avoice input unit which is used to input a voice; a user input unit whichreceives a user's input; a display unit which displays the imagethereon; a wireless communication unit which communicates with acounterpart mobile terminal through a wireless network; and a controllerwhich performs a video call by transmitting to the counterpart mobileterminal video call data comprising a video generated by the camera anda voice input by the voice input unit according to the user's input,displays on the display unit a shared image during the video call, andtransmits to the counterpart mobile terminal the shared image added tothe video call data.

According to another embodiment of the present invention, a mobileterminal is provided, which includes a camera for taking a photographand generating an image; a voice input unit which is used to input avoice; a display unit which displays the image thereon; a wirelesscommunication unit which communicates with a counterpart mobile terminalthrough a wireless network; and a controller which performs a video callby transmitting to the counterpart mobile terminal a video generated bythe camera and a voice input by the voice input unit, receives videocall data comprising a video of a video call and a shared image from thecounterpart mobile terminal during the video call, and displays on thedisplay unit the video of the video call and the shared image. The videocall data may further include edited information of the shared image,and the controller may display the shared image reflecting the editedinformation.

The mobile terminal may further include a user input unit which receivesa user's input, and the controller may edit the shared image accordingto the user's input and transmit the edited information of the sharedimage to the counterpart mobile terminal.

The mobile terminal may further include a user input unit which receivesa user's input, and the controller may select the shared image accordingto the user's input and transmit the selection information of the sharedimage to the counterpart mobile terminal.

The mobile terminal may further include a user input unit which receivesa user's input, and the controller may transmit the shared image to atleast one electronic device selected by user input. According to anotherembodiment of the present invention, a mobile terminal is provided,which includes a camera for taking a photograph and generating an image;a voice input unit which is used to input a voice; a display unit whichdisplays the image thereon; a wireless communication unit whichcommunicates with a counterpart mobile terminal and at least oneelectronic device having a display function through a wireless network;and a controller which performs a video call by transmitting to thecounterpart mobile terminal a video generated by the camera and thevoice input by the voice input unit, receives video call data comprisinga video of a video call and a shared image from the counterpart mobileterminal during the video call, and transmits the shared image to theelectronic device.

The mobile terminal may further include a user input unit which receivesa user's input, and the controller may select the shared image accordingto the user's input and transmit selection information of the sharedimage to the counterpart mobile terminal.

The mobile terminal may further include a user input unit which receivesa user's input, and the controller may transmit the shared image to atleast one of a plurality of electronic devices selected according to theuser's input.

According to another embodiment of the present invention, a displayapparatus is provided, which includes a signal receiver which receivesan image signal; a signal processor which processes the image signalreceived by the signal receiver; a display unit which displays thereonan image based on the image signal processed by the signal processor; awireless communication unit which communicates with a mobile terminalthrough a wireless network; a user input unit which receives a user'sinput; and a controller which receives a shared image and first editedinformation of the shared image from the mobile terminal, displays onthe display unit the shared image reflecting the first editedinformation, edits the shared image according to the user's input andtransmits second edited information to the mobile terminal according tothe user's input.

According to another embodiment of the present invention, a controlmethod of a mobile terminal which is connected to a counterpart mobileterminal through a wireless network, the control method is provided,which includes performing a video call by transmitting and receivingvideo call data comprising a video and a voice to/from the counterpartmobile terminal; displaying a shared image during the video call; andtransmitting the video call data to the counterpart mobile terminal byadding the shared image to the data.

The control method may further include editing the shared imageaccording to a user's input, and the transmitting may includetransmitting to the counterpart mobile terminal edited information ofthe shared image by being added to the video call data.

The control method may further include receiving edited information of acounterpart for the shared image from the counterpart mobile terminal;and displaying the shared image reflecting the edited information of thecounterpart.

The control method may further include receiving selection informationof the shared image from the counterpart mobile terminal; and selectingthe shared image according to the selection information.

According to another embodiment of the present invention, a controlmethod of a mobile terminal which is connected to a counterpart mobileterminal through a wireless network is provided, which includesperforming a video call by transmitting and receiving a video and avoice to/from the counterpart mobile terminal; receiving video call datacomprising the video of the video call and the shared image from thecounterpart mobile terminal during the video call; and displaying thevideo and the shared image.

The control method may further include editing the shared imageaccording to user input, and transmitting edited information accordingto the user's input to the counterpart mobile terminal.

The control method may further include selecting the shared imageaccording to user input, and transmitting selection information of theshared image to the counterpart mobile terminal.

The control method may further include transmitting the shared image toa display apparatus which is connected by a wireless network.

The control method may further include selecting at least one of aplurality of electronic devices which have a display function, andtransmitting the shared image to the at least one selected electronicdevice.

The control method may further include converting the shared image to betransmitted corresponding to a characteristic of the selected electronicdevice.

According to another embodiment of the present invention, a controlmethod of a mobile terminal which is connected to a counterpart mobileterminal and at least one electronic device having a display function,through a wireless network, the control method is provided, whichincludes performing a video call by transmitting and receiving a videoand a voice to/from the counterpart mobile terminal; receiving videocall data comprising a video of a video call and a shared image from thecounterpart mobile terminal during the video call; and transmitting theshared image to the electronic device.

The control method may further include receiving a user's editedinformation from the display apparatus; and transmitting a user's editedinformation to the counterpart mobile terminal.

The control method may further include selecting the shared imageaccording to a user's input; and transmitting selection information ofthe shared image to the counterpart mobile terminal.

The control method may further include selecting at least one of aplurality of electronic devices, and the transmitting may includetransmitting the shared image to the at least one selected electronicdevice.

The control method may further include converting the shared image to betransmitted corresponding to the characteristic of the selectedelectronic device.

According to another embodiment of the present invention, a controlmethod of a display apparatus which displays an image by receiving andprocessing an image signal, and is connected to a mobile terminalthrough a wireless network, is provided, which includes receiving ashared image and first edited information of the shared image from themobile terminal; displaying the shared image reflecting the first editedinformation; editing the shared image according to a user's input; andtransmitting second edited information according to the user's input tothe mobile terminal.

BRIEF DESCRIPTION OF THE DRAWINGS

The above and other aspects, features and advantages of certainembodiments of the present invention will become apparent and morereadily understood from the following description, taken in conjunctionwith the accompanying drawings, in which:

FIG. 1 is a diagram illustrating a mobile terminal and a displayapparatus according to an embodiment of the present invention;

FIG. 2 is a block diagram of the mobile terminal in FIG. 1;

FIGS. 3 and 4 are flowcharts showing operations of the mobile terminalin FIG. 2;

FIGS. 5A-5C and 6A-6B are diagrams illustrating display states of themobile terminal in FIGS. 3 and 4;

FIG. 7 is a block diagram of the display apparatus in FIG. 1;

FIGS. 8 and 9 are flowcharts showing operations of the mobile terminalin FIG. 2 and the display unit in FIG. 7; and

FIGS. 10A-10C and 11A-11B are diagrams illustrating display states ofthe mobile terminal in FIGS. 8 and 9.

DETAILED DESCRIPTION OF THE EMBODIMENTS OF THE PRESENT INVENTION

Hereinafter, various embodiments of the present invention will bedescribed in detail with reference to accompanying drawings so as to beeasily understood by a person having ordinary skill in the art. Variouschanges and modifications of the embodiments described herein can bemade without departing from the scope and spirit of the invention. Inaddition, descriptions of well-known functions and parts are omitted forclarity, and like reference numerals refer to like elements throughout.

FIG. 1 illustrates a mobile terminal according to an embodiment of thepresent invention. As shown therein, mobile terminals 1 and 2 areconnected in a wireless network and communicate with each other. Mobileterminals 1 and 2 according to the present embodiment provide a wirelessnetwork communication function and may be various devices such as amobile phone, a mobile PC or a PDA.

Mobile terminals 1 and 2 also perform a calling function for a telephonecall between a caller and a receiver. One of the mobile terminals is acaller terminal and the other one is a receiver terminal. A telephonecall which is made by mobile terminals 1 and 2 includes a video call bywhich users transmit and receive video and voice during the telephonecall. To perform a video call function according to the presentembodiment, mobile terminals 1 and 2 may perform various communicationssuch as Wideband Code Division Multiple Access (W-CDMA), Enhanced Datarates for GSM Evolution (EDGE), Long Term Evolution (LTE), and WorldwideInteroperability for Microwave Access (WiMAX).

As shown in FIG. 1, a wireless network according to the embodiment ofthe present invention may include base station transmission systems 41and 42 to transmit and receive wireless communication signals withmobile terminals 1 and 2, a base station controller 5 to control andmanage the plurality of base station transmission systems 41 and 42, anda mobile switching center 6 to perform a call connection between mobileterminals 1 and 2 through base station controller 5. Also, as shown inFIG. 1, a service server 8 is in link with the mobile switching center 6through a network 7, and provides service for the video call between thepair of mobile terminals 1 and 2. Network 7 may include the Internet.

During a video call, mobile terminals 1 and 2 according to theembodiment of the present invention enable a caller and a receiver toshare a predetermined image (hereinafter, “shared image”). During avideo call, mobile terminals 1 and 2 also enable a caller or a receiverto edit the shared image and share the edited result (hereinafter,“edited information”). Hereinafter, mobile terminals 1 and 2, will bedescribed according to the embodiment of the present invention, in moredetail with reference to FIG. 2.

FIG. 2 is a block diagram of mobile terminals 1 and 2 according to theembodiment of the present invention. Even though the pair of mobileterminals 1 and 2 are separate apparatuses, FIG. 2 illustrates the twomobile terminals 1 and 2 together for purposes of convenience. It isassumed that, among the pair of mobile terminals 1 and 2 shown in FIG.2, mobile terminal 1 is a caller terminal and mobile terminal 2 is areceiver terminal.

As shown therein, the caller mobile terminal 1 includes a camera 11, avoice input unit 12, a wireless communication unit 13, a display unit14, a voice output unit 15, a user input unit 16 and a controller 18.

Camera 11 captures image and generates photograph and video used for avideo call. Camera 11 may include an optical unit (not shown) includingat least one light-incident lens and an imaging sensor (not shown)converting incident light into electrical data to generate an image.

Voice input unit 12 may include a voice sensor (not shown) such as amicrophone, and receives a voice used for a voice call.

Wireless communication unit 13 is connected to a wireless network andcommunicates with the counterpart mobile terminal 2 by a predeterminedwireless communication method. During a video call, wirelesscommunication unit 13 transmits to the counterpart mobile terminal 2video call data including a video generated by camera 11 and a voiceinput by voice input unit 12 and receives video call data including avideo and a voice from the counterpart mobile terminal 2 according tothe control of controller 18.

Display unit 14 displays thereon a video, and may include a displaypanel (not shown) such as a Liquid Crystal Display (LCD) panel. Displayunit 14 according to the present embodiment displays thereon a videoreceived from the counterpart mobile terminal 2 according to the controlof controller 18 during a video call.

Voice output unit 15 outputs a voice, and may include a voice outputunit (not shown) such as an internal speaker. Voice output unit 15 mayfurther include a connector (not shown) to be connected to an externalvoice output device (not shown) such as earphones, headsets and externalspeakers, and may output a voice to the connected external voice outputdevice. Voice output unit 15 according to the present embodiment outputsa voice from the counterpart mobile terminal 2 according to the controlof controller 18 during a voice call or a video call.

User input unit 16 receives a user's input to manipulate mobile terminal1. User input unit 16 may include a keypad (not shown) including aplurality of keys to input numbers, or characters. The keypad accordingto the present embodiment may include a touch pad. User input unit 13according to the present embodiment may further include a sensor (notshown) to sense a user's motion or gesture as a user's input on displayunit 14. The sensor of user input unit 13 may include a touch screenoverlapping the display panel of display unit 14 such as an LCD panel.

Controller 18 controls mobile terminal 1 as a whole. If a video callfunction is selected by user input through user input unit 16,controller 18 refers to an input telephone number and requests a callconnection to the counterpart mobile terminal 2 through wirelesscommunication unit 13. If the call connection to the counterpart mobileterminal 2 is made, controller 18 transmits video call data including avideo generated by camera 11 and a voice input by voice input unit 12 tothe counterpart mobile terminal 2 through wireless communication unit13, and controls display unit 14 and voice output unit 15 to output thevideo and the voice included in the video call data received from thecounterpart mobile terminal 2 through wireless communication unit 13,respectively.

Returning to FIG. 2, the receiver mobile terminal 2 includes a camera21, a voice input unit 22, a wireless communication unit 23, a displayunit 24, a voice output unit 25, a user input unit 26 and a controller28. Camera 21, voice input unit 22, wireless communication unit 23,display unit 24, voice output unit 25, user input unit 26 and controller28 of the receiver mobile terminal 2, according to the presentembodiment, correspond to camera 11, voice input unit 12, wirelesscommunication unit 13, display unit 14, voice output unit 15, user inputunit 16 and controller 18 of the caller mobile terminal 1, respectively.Hereinafter, unless otherwise stated herein, each element of receivermobile terminal 2 performs the same or similar operations as thosecorresponding to caller mobile terminal 1.

Wireless communication unit 23 of the receiver mobile terminal 2communicates with the counterpart mobile terminal 1 as the caller mobileterminal 1 through the wireless network. Upon receiving a request for acall connection from the counterpart mobile terminal 1, controller 28 ofthe receiver mobile terminal 2 informs a user of the foregoing throughvoice output unit 25, and initiates a video call according to user inputfor confirming a call response through user input unit 26. At the timeof a video call, controller 28 transmits to the counterpart mobileterminal 1 a video generated by camera 21 and a voice input by voiceinput unit 22 through wireless communication unit 23, and controlsdisplay unit 24 and voice output unit 25 to output a video and a voicereceived from the counterpart mobile terminal 1 through wirelesscommunication unit 23, respectively.

During a video call, mobile terminals 1 and 2 according to the presentembodiment may display a shared image for both users to share suchimage. Further, mobile terminals 1 and 2 may edit the shared image,transmit the edited information to the counterpart mobile terminal andshare the edited information of the shared image. Hereinafter,operations of mobile terminals 1 and 2 will be described in more detailwith reference to FIGS. 3 through 6.

FIGS. 3 and 4 are flowcharts of detailed operations of mobile terminals1 and 2 according to the embodiment of the present invention. FIGS. 5and 6 illustrate a shared image and edited information which aredisplayed by mobile terminals 1 and 2, respectively, as shown in FIGS. 3and 4. Referring to FIGS. 3 and 4, mobile terminals 1 and 2 transmit andreceive video call data including a video and a voice to/from thecounterpart mobile terminal and perform a video call in steps 301 and401.

Referring to FIG. 3, in step 302 controller 18 of mobile terminal 1displays on display unit 14 a shared image 143 together with a video 141of a video call during the video call as shown in FIG. 5B. Controller 18of mobile terminal 1 transmits to the counterpart mobile terminal 2 theshared image 143 displayed on display unit 14 together with the video141 of the video call. The counterpart mobile terminal 2 may display theshared image together with the video of the video call upon receivingvideo call data including the shared image from mobile terminal 1 duringthe video call to mobile terminal 1. For example, as in FIG. 6A, a video241 of a video call and a shared image 243 may be displayed on displayunit 24 of the counterpart mobile terminal 2. Reference numeral 244 inFIG. 6A refers to edited information (to be described later) and isinvisible in this step.

At operation 302, sharing an image may be initiated by a user's inputthrough user input unit 16. For example, controller 18 of mobileterminal 1 may display on display unit 14 a menu 142 to share the imageaccording to user input, and initiate sharing the image 143 of FIG. 5according to user selection of menu 142 during a video call as shown inFIG. 5A. Menu 142 is displayed for sharing the image and may bedisplayed as a popup on video 141 for the video call. Sharing the imagemay be initiated upon a request from a user of the counterpart mobileterminal 2. For example, the counterpart mobile terminal 2 transmitsrequested information to mobile terminal 1 upon receiving a request forsharing the image from a user of the counterpart mobile terminal 2during a video call. Upon receiving the request for sharing the imagefrom the counterpart mobile terminal 2, mobile terminal 1 may initiatesharing the image.

Controller 18 of mobile terminal 1 displays on display unit 14 apredetermined shared image 143 as shown in FIG. 5B upon selecting menu142 for sharing the image by a user. Shared image 143, according to thepresent embodiment, may be various types of images e.g., a photo, apicture or a video, selected by a user and displayed on display unit 14.

Mobile terminal 1 according to the embodiment of the present inventionmay further include a storage unit 17, as shown in FIG. 2, which is anon-volatile memory such as a flash memory and stores therein the sharedimage 143. Controller 18 of mobile terminal 1 may display on displayunit 14 a shared image selecting menu (not shown) and allow a user toselect the shared image 143 stored in storage unit 17 upon selecting theimage sharing menu 142 by a user. The shared image 143 may be selectedby not only a user of mobile terminal 1 but also by a user of thecounterpart mobile terminal 2. More specifically, mobile terminal 1transmits to the counterpart mobile terminal 2 information of the sharedimage 143 upon receiving a request for selecting the shared image 143from the counterpart mobile terminal 2. A user of the counterpart mobileterminal 2 selects an image to be shared based on the information ofshared image 143, and transmits to mobile terminal 1 a selection resultof the shared image 143. Mobile terminal 1 displays on display unit 14the shared image 143 according to the selection result from thecounterpart mobile terminal 2.

As shown in FIG. 5B, the shared image 143 according to the presentembodiment is displayed on display unit 14 together with the video 141of the video call. Accordingly, a user may directly view the sharedimage 143 during a video call, and may share information moreconveniently.

In step 302, controller 18 of mobile terminal 1 may edit the sharedimage 143 during a video call. The shared image 143 according to thepresent embodiment may be edited by a user's input through user inputunit 16, and may be provided as various types relating to the sharedimage 143. For example, editing the shared image 143 includes adding animage indicating a user's gesture for the shared image 143 (hereinafter,“gesture image” 144) as shown in FIG. 5B. Controller 18 of mobileterminal 1 displays on display unit 14 the gesture image 144 overlappingthe shared image 143 through a touch screen of user input unit 16 ofdisplay unit 14 if it is determined that a user's gesture for the sharedimage is present. The gesture image 144 according to the presentembodiment is an example of the edited information according to thepresent invention.

Returning to FIG. 3, if the shared image 143 is edited in step 303,controller 18 of mobile terminal 1 transmits to the counterpart mobileterminal 2 video call data added with the shared image 143 and theedited information 144 through wireless communication unit 13. Accordingto another embodiment, editing the shared image may be omitted and thevideo call data may not include the edited information 144. According tothe following embodiment, the shared image is edited as an example, butthe present invention is not limited thereto.

The method of transmitting to the counterpart mobile terminal the videocall data added with the shared image 143 and the edited information 144may vary. For example, controller 18 of mobile terminal 1 may combinethe video 241 of the video call and the shared image 143 to generatecombined images 241 and 143, and may transmit to the counterpart mobileterminal 2 the video 241 of the video call and the shared image 143 asthe combined images 241 and 143. Further, controller 18 may reflect theedited information to the combined image.

According to another embodiment, controller 18 of mobile terminal 1 maytransmit to the counterpart mobile terminal 2 the shared image 143 andthe edited information 144 individually. For example, controller 18 maydivide blocks of single video call data or provide blocks of a pluralityof video call data, and load data of the video 241 of the video call,the shared image 143 and the edited information to the provided blockand transmit such data to the counterpart mobile terminal 2. Controller18 may add identification information to the data of the video 241 ofthe video call, the shared image 143 and the edited information 144 andhave the counterpart mobile terminal 2 identify and process the data.The identification information according to the present embodiment mayinclude meta data, which may include information of a format or a sourceof the video 241.

Referring to FIG. 4, in step 402, controller 28 of mobile terminal 2receives the video call data including the shared image 143 and theedited information 144 from the counterpart mobile terminal 1 during avideo call. For example, controller 28 of mobile terminal 2 maydetermine whether the counterpart mobile terminal 1 transmits the video241 of the video call, the shared image 143 and the edited information144 as a combined image, and control wireless communication unit 23 toreceive the combined image. Controller 28 of mobile terminal 2 mayconfirm the identification information included in the video call datareceived from the counterpart mobile terminal 1, and control wirelesscommunication unit 23 to separately receive the video 241 of the videocall, the shared image 143 and the edited information 144 based on theidentification information.

As shown in FIG. 6A, display unit 24 of mobile terminal 2, controlled bycontroller 28, displays the shared image 243 reflecting the editedinformation 244, together with the video 241 of the video call, duringthe video call in step 403. For example, controller 28 of mobileterminal 2 may receive combined images 241, 243 and 244 from thecounterpart mobile terminal 1, and display such combined images 241, 243and 244 on display unit 24. Controller 28 of mobile terminal 2 mayprocess data of video 241 of the video call, the shared image 243 andthe edited information 244 received as individual information, anddisplay on display unit 24 the video 241 of the video call and theshared image 243 reflecting the edited information 244.

As above, the shared image 243 and the edited information 244 accordingto the present embodiment are displayed together with the video 241 ofthe video call. Accordingly, a user of mobile terminal 2 may immediatelyreceive and view the edited result of the shared image from thecounterpart during a video call to the counterpart, and may share moreinformation efficiently.

According to another embodiment, referring to step 404 in FIG. 4,controller 28 of mobile terminal 2 may edit the shared image 243according to user input through user input unit 26, and in step 405transmit to the counterpart mobile terminal 1 the edited information 245of FIG. 6B according to user input. Referring to step 305 in FIG. 3,controller 18 of mobile terminal 1 receives edited information 245 ofthe counterpart mobile terminal 2, and displays on display unit 14 theshared image 143 reflecting the counterpart's edited information 145, asshown in FIG. 5C. Accordingly, both parties to the call may participatein editing the shared image, and share the image more conveniently.

Editing the shared image 143 is not limited to the foregoing embodiment,and may vary. For example, enlarging, reducing or rotating the sharedimage 143 or changing color or adjusting at least a part of the sharedimage 143 may fall under editing. Text input by a user may also be addedto the shared image 143.

Hereinafter, another embodiment of the present invention will bedescribed with reference to FIGS. 1, and 7 through 11. Referring to FIG.1, mobile terminal 2 according to the present embodiment communicateswith a display apparatus 3 such as a Television (TV). FIG. 7 is a blockdiagram of display apparatus 3 according to the embodiment of thepresent invention. As shown therein, display apparatus 3 may include asignal receiver 31, a signal processor 32, a display unit 33, a wirelesscommunication unit 34, a user input unit 35 and a controller 36.

Signal receiver 31 receives an image signal. The image signal accordingto the present embodiment includes a broadcasting signal having aplurality of channels. The broadcasting signal may include a Digital TV(DTV) signal. Signal processor 32 processes an image signal received bysignal receiver 31. Signal processor 32 may demultiplex, decode, enhanceor scale the image signal. Display unit 33 displays an image thereonbased on an image signal processed by signal processor 32. Display unit33 may include a display device (not shown) such as an LCD, a PlasmaDisplay Panel (PDP), or an Organic Light Emitting Diode (OLED).

Wireless communication unit 34 communicates with mobile terminal 2.Communication between wireless communication unit 34 and mobile terminal2 includes a home network communication such as Digital Living NetworkAlliance (DLNA). Wireless communication unit 23 of mobile terminal 2further includes a communication function with respect to wirelesscommunication unit 34 of display unit 33. User input unit 35 is providedas a remote controller or a manipulation panel, and receives user input.Controller 36 controls display apparatus 3 as a whole. Display apparatus3 may further include a voice output unit (not shown) to output a voicesuch as a speaker and a power supply unit (not shown) to supply power.

FIGS. 8 and 9 are flowcharts of operations of mobile terminal 2 anddisplay apparatus 3 according to the present embodiment. FIGS. 10 and 11illustrate a display state of mobile terminal 2 and display apparatus 3as shown in FIGS. 8 and 9. Hereinafter, mobile terminal 2 according tothe present embodiment will be described with reference to FIGS. 8 to11, and the configuration which is the same or similar to that of mobileterminal 2 according to the foregoing embodiment described withreference to FIGS. 2 to 6 will be omitted.

Referring to FIG. 8, in step 801, controller 28 of mobile terminal 2transmits and receives video call data including a video and a voiceto/from the counterpart mobile terminal 1 and performs a video call.During the video call, in step 802, controller 28 of mobile terminal 2receives the video call data including the shared image and the editedinformation from the counterpart mobile terminal 1. The received sharedimage 243 and the edited information 244 may be displayed on displayunit 24 together with the video 241 of the video call as shown in FIG.10A.

In step 803, controller 28 of mobile terminal 2 transmits to displayapparatus 3 the received shared image 243 and the edited information 244through wireless communication unit 23 during the video call. As shownin FIG. 10B, in transmitting the shared image 243 and the editedinformation 244 to display apparatus 3, controller 28 of mobile terminal2 may display menu 246 on display unit 33 for transmitting the sharedimage, have a user select menu 246 through user input unit 35, andinitiate transmitting the shared image 243 and the edited information244.

In step 901 of FIG. 9, controller 36 of display apparatus 3 receives theshared image 243 and the edited information 244 from mobile terminal 2through wireless communication unit 34. In step 902, controller 36 ofdisplay apparatus 3 displays on display unit 33 a shared image 331reflecting edited information 332 received from mobile terminal 2 asshown in FIG. 11A. This enables users to share the shared image and theedited information on a screen larger than mobile terminal 2, withbetter picture quality, also improving the information sharingenvironment.

In step 903 of FIG. 9, controller 36 of display apparatus 3 edits theshared image 331 displayed on display unit 33 according to user inputthrough user input unit 35 such as a remote controller. Editing theshared image 331 in display apparatus 3 may include, e.g., adding animage 333 of a user's gesture with respect to the shared image 331 asshown in FIG. 11B. Image 333 is another example of the editedinformation. The shared image 331 may be edited by selecting a key ofthe remote controller of user input unit 35 in display apparatus 3 ormay be edited by detecting a user's motion or gesture by a motion sensor(not shown) of the remote controller of user input unit 35. In step 904of FIG. 9, controller 36 of display apparatus 3 transmits to mobileterminal 2 the edited information 333 according to user input throughwireless communication unit 24. Only the edited information 333 may betransmitted to mobile terminal 2 or the shared image 331 reflecting theedited information 333 may be transmitted.

Referring to FIG. 8, in step 804, controller 28 of mobile terminal 2receives a user's edited information 333 with respect to the sharedimage 333 from display apparatus 3. As shown in FIG. 10C, the receivededited information 245 may be displayed on display unit 24. Returning toFIG. 8, in step 805, controller 28 of mobile terminal 2 transmits to thecounterpart mobile terminal 1 the shared image 243 and the editedinformation 245 together with the video 141 of the video call.

Hereinafter, mobile terminal 2 according to another embodiment of thepresent invention will be described. The configuration of mobileterminal 2 which is the same or similar to that of mobile terminal 2according to the foregoing embodiment described with reference to FIGS.1 through 11 will be omitted. According to the present embodiment, it isassumed that a plurality of electronic devices (not shown) which can beconnected to mobile terminal 2 for communication exists around mobileterminal 2. The electronic device according to the present embodimentincludes all of devices which communicate with mobile terminal 2 anddisplay an image such as a computer system or a smart phone as well asdisplay apparatus 3 described with reference to FIGS. 7, 9 and 11.

During a video call to the counterpart mobile terminal 1, mobileterminal 2 selects at least one of a plurality of electronic devices,and transmits the shared image to the selected electronic device. Theelectronic device displays the shared image transmitted by mobileterminal 2. Mobile terminal 2 may transmit to the selected electronicdevice the edited information of the shared image and/or a video of thevideo call, together with the shared image, and the electronic devicemay display the transmitted edited information and/or the video of thevideo call. Mobile terminal 2 may transmit the shared image to at leastone of a plurality of electronic devices that a user has selected.

In selecting the electronic device among the plurality of electronicdevices to transmit the shared image, etc., a characteristic of eachelectronic device may be considered. The characteristic of theelectronic device according to the present embodiment includes acharacteristic of the device itself, the surrounding environment,connectivity, and a supporting codec. Information of the characteristicof the plurality of electronic devices (hereinafter, “device characterinformation”) may be transmitted to mobile terminal 2 from eachelectronic device or stored in advance in storage unit 27 of mobileterminal 2. Mobile terminal 2 refers to the device characterinformation, and selects at least one of a plurality of electronicdevices which is determined to be proper for transmitting the sharedimage.

In selecting the electronic device to transmit the shared image, etc., acharacteristic of the shared image may be considered. The characteristicof the shared image according to the present embodiment includes aresolution of an image, data volume, etc. Mobile terminal 2 may selectat least one of a plurality of electronic devices that corresponds tothe characteristic of the shared image to be transmitted. For example,if a resolution of the shared image is high, mobile terminal 2 mayselect an electronic device that has high display resolution among theplurality of electronic devices. As another example, if the data volumeof the shared image is large, mobile terminal 2 may select an electronicdevice that has good data processing capability (or processingperformance, processing speed) among the plurality of electronicdevices.

In selecting the electronic device to transmit the shared image, etc., acharacteristic of a user of mobile terminal 2 may be considered. Thecharacteristic of a user according to the present embodiment includesage, physical condition, preference and device usage pattern of a user.Information of a user's characteristic (hereinafter, “user characterinformation”) may be stored in storage unit 27 of mobile terminal 2. Theuser character information may be set and/or changed by a user of mobileterminal 2. Mobile terminal 2 may refer to the user characterinformation and select at least one of a plurality of electronic devicesthat corresponds to a user's characteristic. For example, if a user ispresbyopic, an electronic device having a larger screen may be selected.

Mobile terminal 2 may convert the shared image to be consistent with theelectronic device which receives such shared image. Mobile terminal 2may convert the shared image in consideration of the device characterinformation of the electronic device. For example, mobile terminal 2 maychange a resolution or format of the shared image to be consistent withthe electronic device that receives such shared image.

Although several embodiments have been shown and described, it will beappreciated by those skilled in the art that changes may be made inthese embodiments without departing from the principles and spirit ofthe invention, the scope of which is defined in the appended claims andtheir equivalents.

What is claimed is:
 1. A handheld device for performing a videocommunication, the handheld device comprising: a touch display; acellular communication interface; a memory storing instructions; and aprocessor configured to execute the stored instructions to at least:control to perform a video communication with another handheld devicethrough the cellular communication interface by sending video datatoward the other handheld device and receiving video data originatingfrom the other handheld device, control to send, toward the otherhandheld device, a selection of a content to be displayed in the otherhandheld device during the video communication to cause the selectedcontent to be displayed in the other handheld device, wherein thecontent is stored in the other handheld device, control to provide videodata in a first display area of the touch display and provide theselected content in a second display area of the touch display based onthe selection during the video communication, control to receive firsthandwritten information originating from the other handheld device asdata separate from the selected content, wherein the first handwritteninformation is associated with the selected content, control to providethe selected content and the received first handwritten informationtogether in the second display area during the video communication basedon association between the selected content and the received firsthandwritten information, and control to send, toward the other handhelddevice, second handwritten information inputted in the second displayarea in which the selected content and the received first handwritteninformation are provided together during the video communication as dataseparate from the selected content, wherein the second handwritteninformation is associated with the selected content, wherein video data,the first handwritten information, the second handwritten information,and the content are communicated through the same cellular communicationinterface.
 2. The handheld device according to claim 1, wherein thecontent and the second handwritten information are associated with thevideo communication for sending video data to the other handheld device.3. The handheld device according to claim 1, wherein the selectedcontent and the second handwritten information are associated with videodata.
 4. The handheld device according to claim 1, wherein the processoris configured to execute the stored instructions further to control toprovide video data and the selected content together to the touchdisplay of the handheld device.
 5. The handheld device according toclaim 3, wherein the selected content and the second handwritteninformation are associated with video data based on addingidentification information to the selected content and the secondhandwritten information.
 6. The handheld device according to claim 1,wherein at least one of the first handwritten information and the secondhandwritten information includes a handwritten drawing.
 7. The handhelddevice according to claim 1, wherein video data is obtained through acamera of the handheld device.
 8. The handheld device according to claim1, wherein the processor is configured to execute the storedinstructions further to control to transmit, to an external devicethrough a wireless communication interface of the handheld device, datafor displaying the content, the first handwritten information, and thesecond handwritten information on the external device.
 9. A controlmethod of a handheld device for performing a video communication, thecontrol method comprising: controlling to perform a video communicationwith another handheld device through a cellular communication interfaceby sending video data toward the other handheld device and receivingvideo data originating from the other handheld device; controlling tosend, toward the other handheld device, a selection of a content to bedisplayed in the other handheld device during the video communication tocause the selected content to be displayed in the other handheld device,wherein the content is stored in the other handheld device; controllingto provide video data in a first display area of the touch display andprovide the selected content in a second display area of the touchdisplay based on the selection during the video communication;controlling to receive first handwritten information originating fromthe other handheld device as data separate from the selected content,wherein the first handwritten information is associated with theselected content; controlling to provide the selected content and thereceived first handwritten information together in the second displayarea during the video communication based on association between theselected content and the received first handwritten information; andcontrolling to send, toward the other handheld device, secondhandwritten information inputted in the second display area in which theselected content and the received first handwritten information areprovided together during the video communication as data separate fromthe selected content, wherein the second handwritten information isassociated with the selected content, wherein video data, the firsthandwritten information, the second handwritten information, and thecontent are communicated through the same cellular communicationinterface.
 10. The control method according to claim 9, wherein thecontent and the second handwritten information are associated with thevideo communication for sending video data to the other handheld device.11. The control method according to claim 9, wherein the selectedcontent and the second handwritten information are associated with videodata.
 12. The control method according to claim 9, further comprising:controlling to provide video data and the selected content together tothe touch display of the handheld device.
 13. The control methodaccording to claim 11, wherein the selected content and the secondhandwritten information are associated with video data based on addingidentification information to the selected content and the secondhandwritten information.
 14. The control method according to claim 9,wherein at least one of the first handwritten information and the secondhandwritten information includes a handwritten drawing.
 15. The controlmethod according to claim 9, further comprising: controlling totransmit, to an external device through a wireless communicationinterface of the handheld device, data for displaying the content, thefirst handwritten information, and the second handwritten information onthe external device.
 16. A non-transitory computer readable recordingmedium storing instructions executable by a processor of a handhelddevice for performing a video communication to cause the processor to atleast: control to perform a video communication with another handhelddevice through a cellular communication interface by sending video datatoward the other handheld device and receiving video data originatingfrom the other handheld device; control to send, toward the otherhandheld device, a selection of a content to be displayed in the otherhandheld device during the video communication to cause the selectedcontent to be displayed in the other handheld device, wherein thecontent is stored in the other handheld device; control to provide videodata in a first display area of the touch display and provide theselected content in a second display area of the touch display based onthe selection during the video communication; control to receive firsthandwritten information originating from the other handheld device asdata separate from the selected content, wherein the first handwritteninformation is associated with the selected content; control to providethe selected content and the received first handwritten informationtogether in the second display area during the video communication basedon association between the selected content and the received firsthandwritten information; and control to send, toward the other handhelddevice, second handwritten information inputted in the second displayarea in which the selected content and the received first handwritteninformation are provided together during the video communication as dataseparate from the selected content, wherein the second handwritteninformation is associated with the selected content, wherein video data,the first handwritten information, the second handwritten information,and the content are communicated through the same cellular communicationinterface.
 17. The non-transitory computer readable recording mediumaccording to claim 16, wherein the content and the second handwritteninformation are associated with the video communication for sendingvideo data to the other handheld device.
 18. The non-transitory computerreadable recording medium according to claim 16, wherein the selectedcontent and the second handwritten information are associated with videodata.
 19. The non-transitory computer readable recording mediumaccording to claim 16, wherein the instructions cause the processorfurther to control to provide video data and the selected contenttogether to the touch display of the handheld device.
 20. Thenon-transitory computer readable recording medium according to claim 18,wherein the selected content and the second handwritten information areassociated with video data based on adding identification information tothe selected content and the second handwritten information.
 21. Thenon-transitory computer readable recording medium according to claim 16,wherein at least one of the first handwritten information and the secondhandwritten information includes a handwritten drawing.
 22. Thenon-transitory computer readable recording medium according to claim 16,wherein the video data is obtained through a camera of the handhelddevice.
 23. The non-transitory computer readable recording mediumaccording to claim 16, wherein the instructions cause the processorfurther to control to transmit, to an external device through a wirelesscommunication interface of the handheld device, data for displaying thecontent, the first handwritten information, and the second handwritteninformation on the external device.
 24. A control method of a handhelddevice for performing a video communication, the control methodcomprising: performing a video communication with another handhelddevice through a cellular communication interface by sending video datatoward the other handheld device and receiving video data originatingfrom the other handheld device; sending, toward the other handhelddevice, a selection of a content to be displayed in the other handhelddevice during the video communication to cause the selected content tobe displayed in the other handheld device, wherein the content is storedin the other handheld device; providing video data in a first displayarea of the touch display and providing the selected content in a seconddisplay area of the touch display based on the selection during thevideo communication; receiving first handwritten information originatingfrom the other handheld device as data separate from the selectedcontent, wherein the first handwritten information is associated withthe selected content; providing the selected content and the receivedfirst handwritten information together in the second display area duringthe video communication based on association between the selectedcontent and the received first handwritten information; and sending,toward the other handheld device, second handwritten informationinputted in the second display area in which the selected content andthe received first handwritten information are provided together duringthe video communication as data separate from the selected content,wherein the second handwritten information is associated with theselected content, wherein video data, the first handwritten information,the second handwritten information, and the content are communicatedthrough the same cellular communication interface.
 25. The controlmethod according to claim 24, wherein the content and the secondhandwritten information are associated with the video communication forsending video data to the other handheld device.
 26. The control methodaccording to claim 24, wherein the selected content and the secondhandwritten information are associated with video data.
 27. The controlmethod according to claim 24, further comprising: displaying video dataand the content together on the touch display of the handheld device.28. The control method according to claim 26, wherein the selectedcontent and the second handwritten information are associated with videodata based on adding identification information to the selected contentand the second handwritten information.
 29. The control method accordingto claim 24, wherein at least one of the first handwritten informationand the second handwritten information includes a handwritten drawing.30. The control method according to claim 24, further comprising:transmitting, to an external device through a wireless communicationinterface of the handheld device, data for displaying the content, thefirst handwritten information, and the second handwritten information onthe external device.